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Abstract 

Abstract: The current investigation was an exploration of the first year of a 
multi-year project designed to provide every Grade 3 to Grade 11 student 
throughout an English school board in Quebec with a laptop computer. Data 
were collected from 403 elementary and 270 secondary students from the 
experimental school board and also from 330 students in the control school 
board. In addition, questionnaire data were collected from 60 elementary 
school teachers and 51 secondary school teachers. Finally, interviews were 
conducted with 72 students and 20 teachers. Potentially the most 
interesting finding was the difference in achievement scores between the 
experimental and control boards. Secondary students from the experimental 
board had higher scores on the CAT-3 reading test and indicated making six 
times more frequent use of computer technology in their English classes, 




suggesting a possible treatment effect. In contrast, math scores were higher 
at the control board where neither board indicated high levels of computer 
use. Nevertheless, these findings must be interpreted with some caution 
until the threats to validity of selection bias are more clearly overcome. 

Resume: L'investigation en cours etait un examen de la premiere annee 
d'un projet pluriannuel qui visait a offrir un ordinateur portable a tous les 
eleves de la 3 e a la 11 e annee d'une commission scolaire anglophone du 
Quebec. Les donnees ont ete recueillies aupres de 403 eleves de 
I'elementaire et de 270 eleves du secondaire de la commission scolaire 
experimental ainsi qu'aupres de 330 eleves de la commission scolaire 
temoin. En plus, on a recueilli des donnees tirees de questionnaires remis a 
60 enseignants de I'elementaire et a 51 enseignants du secondaire. Enfin, 
des entrevues ont ete menees avec 72 eleves et 20 enseignants. La 
conclusion la plus interessante s'avere peut-etre la difference entre les 
resultats de reussite entre les commissions scolaires experimental et 
temoin. Les etudiants du secondaire de la commission scolaire 
experimental ont obtenu de meilleurs resultats pour les tests de lecture 
CAT-3 (formation en matiere d'applications informatiques) et ils ont indique 
utiliser six fois plus souvent la technologie informatique dans leur cours 
d'anglais, laissant croire que le traitement a peut-etre eu des repercussions. 

Par ailleurs, les resultats en mathematiques etaient superieurs a la 
commission scolaire temoin alors qu'aucune commission n'a indique des 
taux d'utilisation eleves de I'ordinateur. Neanmoins, ces conclusions doivent 
etre interpreters avec discernement jusqu'a ce qu'on gere mieux les 
menaces a regard de la validite du biais de selection. 

Ubiquitous Technology Integration in Canadian Public 
Schools: Year One Study ^ 

Enthusiasm for, as well as apprehension regarding, the use of technology for learning 
appears widespread as we herald the arrival of the Information Age. To some, computer 
technology can be used as a powerful and flexible tool for learning (Harasim, Hiltz, Teles & 
Turoff, 1995; Lou, Abrami & d'Apollonia, 2001; Scardamalia & Bereiter, 1996). Indeed, 
there is sufficient optimism in the potential of technology to have a positive impact on 
learning that governments have established task forces and dedicated substantial research 
funds to identifying and promoting ways to deliver or enhance instruction with the use of 
technology. At the same time, there is sufficient scepticism (Healy, 1998; Russell, 1999) 
about the use of technology to improve learning and beliefs that it may even represent 
serious threats to education. For example, it is believed that an imbalance between 
computer skills and essential literacy skills may be created; technology dependencies and 
isolation may be fostered rather than independent and interdependent learners; and the 
joy and motivation to learn may be eroded, replaced by frustration with failed equipment. 
Many teachers hold beliefs concerning the usefulness of information and communication 



technologies (ICT) that parallel their attitudes towards any change to teaching and 
learning, be it through government mandated reform or societal pressure. "If the computer 
can accomplish the task better than other materials or experiences, we will use it. If it 
doesn't clearly do the job better, we will save the money and use methods that have 
already proven their worth" (Healy, 1998, p. 218). 

Technology integration and student achievement 

What has the research evidence revealed about the impact of technology integration, 
broadly defined, on student learning? There are now numerous narrative as well as 
quantitative reviews exploring the primary research on the impact of computer use on 
student achievement. The summaries vary; some suggest positive impacts on student 
learning while others are more equivocal, suggesting the evidence does not yet justify 
concluding that technology impacts positively and pervasively on student learning. 

There are numerous examples of promising results. Kulik and Kulik (1989) cited several 
reviews, as early as during the 1980s, that found positive effects of computer based 
instruction on student performance, with a range of gains from 0.22 standard deviations to 
as high as 0.57 standard deviations. Schacter (1999) cited several studies that reported 
higher achievement, motivation, and engagement for students in a technology-enriched 
environment. In their meta-analysis, Waxman, Lin, and Michko (2003) found positive, 
albeit small, effects of teaching with technology on student outcomes. Sivin-Kachala and 
Bialo (2000) included studies that reported gains in the areas of language arts and reading, 
mathematics, science and medicine, social studies, foreign and second language 
acquisition, and programming languages such as LOGO. Kulik (2003) found that most 
studies looking at the impact of the word processor on student writing have shown 
improved writing skills, as well as a positive impact on teaching programs in math, and in 
the natural and social sciences. Goldberg, Russell and Cook (2003) conducted a meta¬ 
analysis looking at the effect of computer technology on student writing from 1992 to 
2002. Results suggested that students who used computers when learning to write 
produced written work 0.4 standard deviations better than students who did not use 
computers. 

Other reviews of the literature are less enthusiastic. Coley, Cradler and Engel (2000) 
conclude that drill-and-practice forms of computer-assisted instruction can be effective in 
producing achievement gains in students. In contrast, studies of more pedagogically 
complex uses of technology generally have been less conclusive, offering only promising 
and inviting educational vignettes (Coley et al., 2000). Fuchs and Woessmann (2004) 
initially found positive effects of home computer use on mathematics achievement. After 
adjusting for family background and school characteristics, they found "the mere 
availability of computers at home is negatively related to student performance in math and 
reading, and the availability of computers at school is unrelated to student performance" 
(p. 17). Ungerleider and Burns (2002), reviewing mostly Canadian research, found little 
methodologically rigorous evidence of the effectiveness of computer technology in 
promoting achievement, motivation, and metacognitive learning and on instruction in 



content areas in elementary and secondary schools. They also emphasized that student 
academic achievement does not improve simply as a result of having access to computers 
in the classroom without concurrent changes to instruction. We share their concern that 
methodologically sound studies must be undertaken with proper experimental and 
statistical controls. We also believe it is important to conduct longitudinal investigations of 
pervasive and ubiquitous attempts at technology integration. 

One-to-one computer implementations 

The majority of research on technology integration in schools has been conducted when 
students have limited access to technology either by learning in dedicated computer labs 
for select periods during the week or when technology is available in classrooms but at 
ratio of several students per computer. More recently, interest has shifted to more 
widespread technology use, in particular, when each student is provided with a computer 
for use throughout the day. 

The aim of the Maine Learning Technology Initiative (MLTI) was to provide every seventh 
and eighth grade student in the state with a laptop computer. Although the phase one 
summary report and mid-year evaluations of the MLTI (Gravelle, 2003; Lane, 2003; 
Sargent, 2003; Silvernail et al., 2003; Silvernail & Lane, 2004) present promising findings 
in terms of the impact the initiative has had on student learning and achievement, 
interpretation of qualitative and quantitative data obtained from surveys, case studies, 
interviews, focus groups and observations were only collected from students, teachers, 
superintendents and principals with laptops. No data were collected from laptop control 
participants. Davies (2004) evaluated the impact of the MLTI on one class. She found 
positive changes in the way students learn (more risk-taking), in what they learn, the 
context for teaching and learning, and on student willingness to engage in collaborative 
learning. 

The Henrico County Public Schools deployed laptop computers to all students from Grades 
6 to 12 in the district. Similar to the MLTI, Henrico's Teaching and Learning Initiative 
strives to close the digital divide among students and integrate technology across the 
curriculum. Davis, Garas, Hopstock, Kellum and Stephenson (2005) surveyed 29,022 
students, teachers, school administrators, and parents on their experiences and opinions 
of the initiative. The report simply outlines perceived benefits and limitations regarding the 
use of laptops. Data on student learning outcomes were not collected. 

The Peace River Wireless Writing Project involves the deployment of laptop computers to 
students in five Grade 6 and 7 classes. The goal of this project is to increase student 
performance in writing expression (Jeroski, 2003). Early results reveal an increase in 
writing scores on the B.C. Performance Standards compared to the previous year (Jeroski, 
2004). 

Rockman et al. (2000) conducted a three-year evaluation of Microsoft's Anytime Anywhere 
Learning Program, to examine the impact of the laptop program on teaching and learning, 
and on the ways in which laptops might be supporting constructivist pedagogy. The 



research covered 13 schools from eight different sites. They used both internal (within the 
school) and external control groups (another school). Researchers used student and 
teacher survey data, collected logs of computer use, gathered writing samples, 
interviewed school administrators, and analyzed scores from state and nationally normed 
assessments. Rockman et al. found positive changes in student writing, student 
collaboration, and an increase in student confidence towards computing. Results from 
standardized achievement measures were inconclusive. 

Purpose 

The findings of these laptop initiatives are promising but not definitive. There is a lack of 
rigorous, methodologically sound research of one-to-one laptop programs, especially 
large-scale, board-wide projects and on the impact these programs have on student 
learning. The current investigation was an exploration of the first year of a multi-year 
project designed to provide every student with a laptop computer from Grades 3 (cycle 2) 
to 11 (secondary 5), throughout an English school board in Quebec. The primary focus of 
this study was to explore changes in student learning and teaching as a result of the 
laptop integration. The objectives of the current research were consistent with the goals 
established by the experimental school board of exploring the nature and extent to which 
technology supports or impedes student learning, motivation, attitudes, self-concept, and 
self-regulation. 

Methodology 

The technology initiative involves the deployment of laptop computers to every student in 
the school board from elementary cycle 2 (Grades 3 and 4) to secondary 5 (final year of 
high school), over a three year period. Three elementary schools volunteered and were 
subsequently selected to serve as lead schools for the initiative. Cycle 3 students at these 
schools received laptops in May of 2003. The first wave of large-scale deployment, which 
took place in October of 2003, involved the distribution of laptops to cycle three students 
at the Board's twenty elementary schools and secondary 5 students at the three high 
schools. A second school board in Quebec volunteered to serve as a control. The control 
school board used technology typical of other public school deployments where on average 
there were several students per computer and, in general, technology supplemented 
teaching and learning both in quality and quantity of time spent. 

Data collection occurred between January and April 2004. The study conformed to 
Canada's Tri-Council Policy on the ethical treatment of research participants. 

Student participants 

There were both elementary and secondary school participants. 

Elementary level 

The groups at the elementary level comprised cycle 3 (Grades 5 and 6) students from the 
twenty elementary schools. Although most cycle 3 students in the board received laptops 
in October 2003, students in the three lead schools received their laptops in May 2003. 



This meant that at the time when the first round of data collection was conducted, cycle 3 
level two students (Grade 6) in the lead schools had the laptops for seven months (n = 103) 
whereas the other students only had the laptops for four months (n = 300). 

Secondary level 

The deployment of laptops at the high school level included Grade 9 and Grade 11 
students. Nonetheless, data collection at the secondary level focused only on Grade 11 
students. Grade 11 students were selected since in the previous year they completed 
uniform provincial exams in mathematics, physical science and history of Quebec and 
Canada. It was also possible to obtain these provincial exam results for Grade 11 students 
in the control school board. Data were collected from all three high schools in the 
experimental board (n= 270) and four high schools from the control board (n= 330). 

Teacher participants 

Data were collected from teachers at the elementary (n= 60) and secondary levels (n = 
51). At the elementary level, data were collected from cycle 3 teachers. At the secondary 
level, data were collected from all secondary 5 teachers at the experimental and control 
schools. 

Procedure 

A team of two to three data collectors was sent out to each school. The data collectors 
provided the students with instructions for completing the response sheets and provided a 
context for each questionnaire. The Technology Integration Questionnaire (TIQ) was sent 
to the schools. Teachers were given instructions for completing the questionnaire, 
including the procedure for returning them to the school board. 

Interviews were conducted at the three lead schools, three elementary schools that were 
similar in size and setting to the lead schools, at three high schools in the experimental 
board, and four high schools in the control board. School administrators were asked to 
select teachers and students who best represented the school population. Teachers were 
interviewed individually while student interviews were conducted as focus groups of five to 
seven students at each school. Each interview and focus group session was approximately 
20 to 30 minutes in length. 

Interview data and responses to open-ended TIQ questions were coded using 
predetermined and emergent codes. Digital text files of the open-ended responses were 
compiled. HyperResearch was used for coding audio files (interview data) and text files. 

Instruments 

Multiple data collection instruments were used in this research. 

Technology Implementation Questionnaire (TIQ) 

A modified version of the TIQ (Wozney, Venkatesh, & Abrami, 2006) was distributed to 
teachers. The TIQ examines technology integration in the classroom, including both degree 
and quality of use, focusing on both advantages and drawbacks of integration. The TIQ was 



used to help describe and understand differences across teachers in planning and 
implementing technology for learning. 

Student Questionnaire 

The Student Questionnaire was partially based on the NANS/SIAA research on school 
success (Janosz, 2003). This questionnaire was modified to further define socio-economic 
status for individual students, and to match students for the purpose of comparing 
achievement scores. Several questions explored the impact of technology on student 
attitudes and motivation to learn. It was also used to explore student perceived 
advantages and disadvantages of technology use. 

The Student Questionnaire also drew questions from the PedTech2 computer questionnaire 
for students (Lowerison, Sclater, Schmid, & Abrami, in press). These questions were used 
to collect data concerning student use of computers both inside and outside of the school 
environment. These data were used to establish whether a difference in student 
achievement was associated with computer use in general, or on the use of computer 
technology in the classroom specifically, and if the latter, what qualities of use can affect 
student learning. 

Canadian Achievement Test, 3 rd Edition (CAT-3) 

Only the Basic Battery was used for collecting achievement data. The test consisted of a 
series of multiple-choice questions in reading/language (comprehension, vocabulary and 
language) and mathematics. A test consultant from the Canadian Testing Centre 
conducted an item-by-item analysis of the Basic Battery to confirm the test's compatibility 
with the curriculum of the Quebec Education Program. 

Self-Description Questionnaire 

The SDQ (Marsh, 1999) was used to collect self-concept data from students. Elementary 
students completed level one while the secondary students completed level two of the 
SDQ. This questionnaire was used to determine whether the use of technology had an 
effect on student self-concept. The SDQ included questions specific to academics as well 
as more general self-esteem (e.g., body image, ability to make and keep friends). 

Surveys of Self-Regulation 

The Academic Self-regulated Learning (Ryan & Connell, 1989) question-naire and the 
Academic Motivation Scale (Vallerand et al., 1992) were used to collect data on student 
self-regulation. The Academic Self-regulated Learning (SRL-A) was distributed to the 
elementary students while the Academic Motivation Scale (AMS), which is a variation of 
the SRL-A for older children, was distributed to secondary students. These questionnaires 
identify student motivation for learning and completing school-related tasks. 

Interviews 

Student and teacher interview data were used to supplement the quantitative research 
findings. For instance, the interviews served to help describe and understand differences 
across teachers in planning and implementing technology for learning. 



A total of 72 students, representing twelve schools, were interviewed in focus groups of 
five to eight. Thirty-seven students at the cycle 3 level (19 from the three lead schools 
and 18 from remaining schools) and 35 students at the secondary 5 level (17 from the 
three experimental high schools and 18 from three control high schools) volunteered to be 
interviewed. The analysis of the interview data focused on the student's appreciation of 
computer technology integration for learning, their perception of the impacts that 
technology has on their learning, and the problems encountered with the integration of 
technology. 

Teacher interviews were conducted to verify the extent to which computer technology is 
integrated into teaching and how its use impacts on teaching and learning. The analysis of 
the interview data focused on teacher perceptions about introducing computer technology 
in their teaching, their actual use of technology for teaching, their perception of the 
impacts that technology has on student learning and achievement, and on the adequacy of 
professional development and technical support. Two teachers per school were selected by 
the school administration to take part in a one-on-one, face-to-face interview. Eleven 
elementary teachers and nine secondary teachers participated in the interviews. 

Training materials 

Training materials used by the experimental school board were reviewed to gain a clearer 
understanding of the support and professional development offered to the teachers. As 
well, data collected by the school board through focus group sessions with teachers were 
examined. The experimental board offered teachers a three-day training session during the 
summer and consultants from the school board met with small groups of teachers (usually 
three consultants for every 20 teachers) to discuss strategies for using the computers in 
the classroom and for sharing future directions, successes and frustrations. 

Provincial Exam Scores 

Scores on secondary 4 provincial exams were used in conjunction with the high school 
CAT-3 scores. All secondary 4 students in the province of Quebec wrote common end-of- 
year exams in mathematics, physical science and history of Quebec and Canada. An item 
analysis was conducted to establish the likeness between level 19/20 of the CAT-3 math 
test of the basic battery and the secondary 4 provincial math exam. 

Indice milieu socio-economique 

The Indice milieu socio-economique is a formula used by the Quebec Ministry of Education 
(MEQ, 2002) (now the Ministry of Education, Leisure and Sport) to determine each school's 
socio-economic status. Schools are given ratings based on statistics on mothers' level of 
education and whether at least one parent in the household holds a full-time job. These 
data are based on the geographic area where the schools draw their students, not 
necessarily on the specific families within the school. 

Data Analysis Process 

Reliability of the data collection instruments was assessed using Cronbach's alpha. A 
Cronbach's alpha value of .70 is generally considered acceptable, although higher values 



(.80 or above) are preferred. Reliability data could not be calculated for the Canadian 
Achievement Test results because these data were scored externally. 

The Student Questionnaire included 52 items. In some cases, related items were combined 
to form composite scores (e.g., eight questionnaire items that asked students to rate how 
easy it was to perform a variety of tasks using a computer were combined into a single 
score). For item-clusters derived from the Student Questionnaire reliabilities ranged from 
.50 to .76 for elementary students with an average value of .68 and ranged from .46 to .89 
for secondary students with an average value of .73. 

The SDQ for elementary students contains 72 items that can be used to create eight sub¬ 
scales. Cronbach's alpha associated with these sub-scales ranged from .81 to .94 with an 
average value of .86. The SDQ2 for secondary students contains 102 items that can be 
used to create 11 sub-scales, although only eight were used in this research. Cronbach's 
alpha for these SDQ2 sub-scales averaged .86 with a range from .82 to .91. 

The SRL-A for elementary students contains 32 items that are used to produce four sub¬ 
scores. Cronbach's alpha associated with these sub-scores ranged from .75 to .86 with an 
average of .82. The AMS for secondary students contains 28 items that are used to 
generate seven sub-scores. Cronbach's alpha for these sub-scores ranged from .77 to .86 
with an average of .82. 

Missing Data 

Several of the instruments used in this research (e.g., SDQ, AMS, SRG) combined clusters 
of related questionnaire items into sub-scales. For example, the 72 items on the SDQ at 
the elementary level were combined into eight sub-scales. It sometimes occurred that 
students completed all of the items in a particular sub-scale except for one. In this 
situation, the SDQ instructions for analysis recommend that missing item scores be 
replaced by the mean or average score for that particular item. This strategy allows 
students to be retained in the analysis instead of being removed because the sub-score 
could not be created due to the missing information for a single item. This procedure does 
not replace missing data indiscriminately. The replacement of missing data occurs only for 
a small percentage of students and only when those students have provided responses for 
at least 90% of the questionnaire. This approach for replacing missing data was also used 
when creating sub-scale scores for the remaining instruments used in the research. It 
should be noted that missing data were replaced only when clusters of items were used to 
create composite or sub-scale scores. When analyzing data for individual items, students 
with missing data were simply excluded from the analysis for that particular item. 

Results 

We report the findings for several measures and for both elementary and secondary school 
students and teachers. 


Technology Implementation Questionnaire Results 



The TIQ was completed and returned by 60 elementary teachers and 51 secondary 
teachers. Of the elementary teachers, 14 were from lead schools while the remainder (46) 
were from schools that implemented the technology initiative at a later date. Of the 
secondary teachers, 25 were from the experimental board while 26 were from control 
schools. Given the relatively small number of teacher respondents, some caution is 
warranted when interpreting the TIQ results presented in this section of the report. As part 
of a separate study, data for a province-wide sample of elementary (N=448) and 
secondary teachers (N = 276) were collected during the 2002-03 school year. TIQ results 
for the province-wide sample are presented for comparison. 

The proportion of teachers who reported student access to computer technology as good, 
very good, or excellent was higher among elementary (about 90%) and secondary 
teachers (71%) in the experimental board than among secondary teachers in control 
schools (20%) or teachers in the province-wide sample (51%). The percentage of teachers 
who responded that access to computer resource personnel was good, very good or 
excellent was highest in elementary lead schools (71%) and lowest in control secondary 
schools (23%) and schools in the province-wide sample (40%). 

Elementary teachers (72% to 86%) were approximately twice as likely as secondary 
teachers (48% and 35% for experimental and control respectively) to report that they 
frequently integrate computer technologies into their learning activities. In the province¬ 
wide sample, the rate of integration was approximately 29%. Teachers were also asked to 
report their proficiency levels in relation to computer technologies. Average or higher 
levels of proficiency were most prevalent among elementary teachers located in lead 
schools (93%) and lowest among experimental secondary teachers (68%) and teachers in 
the province-wide sample (62% for elementary). Teachers in the province-wide sample 
(36%) and secondary teachers in experimental schools (36%) are least likely to report 
adaptation or creative application of technology into the curriculum while elementary 
teachers in lead schools are most likely to fall into this category (62%). Elementary 
teachers in lead schools expressed more positive views regarding the implementation of 
technology compared to teachers in schools in the Year 1 implementation group. For 
example, teachers in lead schools were less likely to indicate that computer technology 
results in students neglecting important traditional learning resources, makes classroom 
management more difficult, and demands that too much time be spent on technical 
problems. On the other hand, elementary teachers in lead schools were more likely to 
indicate that computer technology promotes student collaboration, promotes the 
development of students' interpersonal skills, and motivates students to get more involved 
in learning activities. 

Although elementary teachers were generally more positive, the majority of respondents 
from the lead schools (79%) also acknowledged that the use of computer technology in 
the classroom requires extra time to plan learning activities. The vast majority of 
experimental teachers (approximately 90%) further agree that there must be adequate 
teacher training in the uses of technology for learning and that technical staff must 



regularly maintain computers (approximately 93%). 


In general, the views expressed by secondary teachers in experimental schools were more 
negative than the views of secondary teachers in control schools. For example, secondary 
teachers in experimental schools were significantly more likely to indicate that computer 
technology: a) requires extra time to plan learning activities; b) is too costly in terms of 
resources, time and effort; c) requires software-skills training that is too time consuming; 
and d) will increase the amount of stress and anxiety that students experience. On the 
other hand, experimental secondary teachers were less likely to indicate that computer 
technology: a) increases academic achievement (e.g., grades); b) is an effective tool for 
students of all abilities; and c) helps accommodate students' personal learning styles. 

A majority of teachers (71% to 93%) use computers to prepare handouts, test/quizzes, 
and homework assignments for students. In a related questionnaire item, they also report 
using word processors with the same frequency. Teachers frequently report use of the 
Internet to search for information for a lesson (58% to 90%). Relatively high percentages 
of teachers also report the frequent use of computer technology to create lessons plans 
(28% to 65%) and e-mail to communicate with other teachers (20% to 44%). There 
appears to be a heavy use of digital video and cameras by elementary teachers in lead 
schools (64%). Secondary teachers (about 70%) are far more likely than elementary 
teachers to use computers to keep track of student grades and marks. 

Elementary Student Results 

Results were analyzed for Grade 5 and 6 students separately but were remarkably 
consistent across the two grades and so were aggregated for the two grades. Female 
students (90%) are significantly more likely than male students (70%) to report that they 
enjoy what they learn in school. Likewise, female students (82%) are more likely to 
indicate that school is fun compared to male students (60%). More than 90% of boys and 
girls indicate that it is important to succeed in English and mathematics. Compared to 
males (75%), a higher percentage of girls (91%) report that their writing skills in English 
are strong or very strong. Results by gender for the CAT-3 confirmed the superior 
performance of female students. Female students achieved a significantly higher level of 
performance in reading, language, spelling, computation, total reading score, and overall 
test battery score. Male students displayed higher performance in mathematics than did 
female students although this difference was not statistically significant. 

In the area of computer use, few gender differences appeared among elementary students. 
Almost all students reported having a computer at home that they could use (89% and 
91% for boys and girls respectively). Access to the Internet at home was less widespread 
but again no gender differences emerged (74% and 77% for boys and girls respectively). 
Approximately 79% of students reported using a computer at home a few times per week 
or almost every day. In contrast, 91% of students reported using a computer at school. 
Boys and girls were equally likely (84%) to report that they enjoyed using a computer to 
complete their schoolwork. 



The number of students who report using a computer for one hour or more per week is as 
follows for each class: English (65%), French (42%), social studies (36%), science (30%), 
and mathematics (14%). When students were asked how often they used a computer to 
do homework outside class for various subject areas, English was identified most often 
(35%) and mathematics was lowest (8%). When looking for information on a particular 
topic, more than 70% of students look first to the Internet rather than consulting books, 
CD ROMs, or another person. Boys and girls (77%) are equally likely to report that using 
computers to complete their schoolwork helps them learn. 

Results were compared for students following an Individual Education Plan (IEP) with non- 
IEP students. On the SRL-A, there are no statistically significant differences between the 
responses of IEP and non-IEP students. IEP students provided significantly lower ratings on 
the following SDQ sub-scales: physical abilities in sports and games; relationship with 
parents; ability, enjoyment, and interest in reading; ability, enjoyment, and interest in 
mathematics; general ability, enjoyment, and interest in school; and, general satisfaction 
with self. In addition, IEP students demonstrate significantly lower levels of performance 
on every CAT-3 subtest. Nonetheless, IEP students report that is equally easy to use 
computers for performing a variety of tasks. IEP students are slightly (but not 
significantly) less likely to use a computer during classes but significantly more likely than 
other students to use a computer for homework outside classes. IEP students are as likely 
as other students to report using a computer for schoolwork at home. Finally, IEP students 
are equally likely to report that using computers to do homework helps them learn. 

At the time of data collection, Grade 6 students in lead schools had used laptop computers 
for a longer period than students in the remaining elementary schools, albeit only several 
months longer. Analyses were conducted to compare these two groups of students 
(identified as lead and year 1). This comparison was intended to examine any differential 
impact on students in the lead schools who had access to the laptop computers for a 
longer period of time than other Grade 6 students. 

Between group comparisons on several measures (e.g., attitudes, self-regulation and CAT- 
3) favoured students in year 1 schools even though students in lead schools had used the 
laptops for a longer period. This result is contrary to what would be expected. Flowever, 
there were large and significant differences in achievement pretest scores that favour the 
students in the year 1 schools and there were a greater number of special needs students 
in the lead schools. This suggests that the populations of students in lead and year 1 
schools may not be sufficiently equivalent prior to the integration of technology. 
Furthermore, we were not able to adequately adjust for these pretest differences using 
analysis of covariance. 

Secondary Student Results 

Overall, secondary students are far less likely than elementary students to indicate that 
they like school and enjoy what they learn at school. While experimental students are 
significantly less likely than control students to have a computer at home, there is no 



significant difference in terms of how often a computer is used for schoolwork at home. As 
expected, experimental students are far more likely than control students to use a 
computer at school in all of their classes. For instance, the majority of experimental 
students use a computer in French (76%) and English class (68%) substantially more 
oftenc ompared to only 5% for control students. In contrast, usage of computers in math 
classes were dramatically lower in both experimental (18% for males and 4% for females) 
and control secondary schools (1% for both males and females). Experimental students 
also report significantly higher usage of computers outside class to do their homework (p 
< .05). 

Although experimental students were far more likely to use a computer at school, did this 
promote more positive attitudes? Experimental students demonstrated a significantly 
lower degree of interest in computers (53% vs. 67%, p < .05) and less enjoyment when 
using computers to complete their schoolwork (58% vs. 64%, p < .05). Finally, 
experimental students (38%) were considerably less likely than control students (62%) to 
indicate that using computers for schoolwork helped them learn. 

Results for the SDQ2 and AMS show that there were no significant differences between 
students in experimental and control high schools on the following dimensions: physical 
abilities in sports and games: physical appearance or attractiveness; honesty- 
trustworthiness; relationship with parents; ability, enjoyment, or interest in reading and 
mathematics; general ability, enjoyment or interest in school; and general satisfaction 
with self. Responses to the AMS, provided by experimental and control students, were very 
similar except on the Amotivation sub-scale where experimental students reported 
significantly higher (p < .05) scores (e.g., I can't see why I go to school and frankly I could 
care less.). Amotivation is significantly higher among male students. 

CAT-3 results showed that experimental secondary students achieved somewhat higher 
levels of performance in reading 51 st percentile vs. 48 th percentile (p > .05). In contrast, 
control students obtained significantly higher scores in mathematics (50 th percentile vs. 
45 th percentile, p < .05). In order for such comparisons to be valid, we must have 
confidence that the students in experimental and control were not significantly different 
before the laptop initiative was implemented in experimental schools. If there are pre¬ 
existing differences between the two groups, then it becomes much more difficult to 
evaluate the impact of the laptop initiative on experimental students. The issue of non¬ 
equivalent groups is complex and the problem does not have a simple solution. One 
strategy we used was the analysis of subsets of the data. Another strategy that is deemed 
to have merit is covariance analysis, which is used to statistically reduce or remove the 
influence of pre-existing differences. 

In this research, several potential covariates were examined. Student Questionnaire items 
asked participants to provide information about the education and employment status of 
their parents. Past research has demonstrated that such socio-demographic variables are 
often correlated with students' academic performance. For this reason, it was reasonable 



to adjust for the education level and employment status of parents when analyzing data 
for experimental and control students. Nonetheless, the use of these variables in the 
covariance analysis had no substantial effect on results and, for this reason, they are not 
reported. 

MEQ scores in mathematics, science, and history were also potential covariates. These 
test scores were collected during the 2003 school year before the laptop initiative was 
implemented in experimental secondary schools. MEQ scores indicated that experimental 
students in the research sample scored significantly lower in mathematics and science 
than did control students before the technology initiative was implemented. It was also 
observed that MEQ scores were significantly correlated with reading, language, and 
mathematics achievement scores on the CAT-3 (Pearson's r values ranged from .31 to .53, 
p < .001). It was therefore reasonable to use MEQ scores as covariates in an effort to 
remove some of the influence of these pre-existing differences in performance. The results 
of the covariance analysis increased the difference between experimental and control in 
reading and decreased the difference in mathematics. Nonetheless, the overall pattern 
remained the same and, for this reason, detailed covariance results are not reported. 

A second strategy, namely matching, was also used to achieve equivalence between 
control and experimental students at the pre-test stage so that possible differences on the 
post-test could be more accurately evaluated. Experimental students were matched to 
control students by finding a control student who had the same MEQ pre-test score but 
was also of the same gender. This methodology was used to create two groups of students 
with equal MEQ scores at the pre-test stage. Matching was done using MEQ scores for 
mathematics, science, and history as the pre-test. Matching was done with each test 
separately and then combining scores from the three tests using a simple sum. In 
approximately 85% of cases exact matches were found. When experimental and control 
test scores could not be matched exactly, test scores were used that were within 1 mark 
of each other (and on a few rare cases within two marks of each other). 

Results differed somewhat depending on which MEQ test was used for matching. For 
example, consider the CAT-3 reading results. Experimental students had some advantage 
on CAT-3 reading scores when math or science MEQ scores were used for matching but 
this trend is reversed when history is used for matching. When all three tests are 
combined, the experimental advantage in CAT-3 reading emerges but is not statistically 
significant (p=.10). 

When considering the CAT-3 scores for math, experimental students were significantly 
lower when matching is based on history scores. When science or math MEQ scores are 
used for matching, math CAT-3 scores for experimental students are quite similar to those 
for control students. When the sum of all three MEQ tests is used for matching, CAT-3 
math scores are significantly higher for control students. 

Teacher Interviews 

Almost all of the 20 teachers interviewed described their role as that of facilitator, or guide 



who listens to students and who, at times, has to take on the role of a parent. They 
described their roles as opening doors, pointing students in new directions, helping them 
understand and share knowledge, and helping students develop critical thinking skills and 
to work autonomously. Their goals are to stimulate the students to want to learn so that 
they can work to their full potential. Three of the elementary school teachers stated that 
the introduction of computer technology changed their role. One teacher reported that the 
laptops changed the style of learning in her classroom from being teacher-led to student- 
centred. Another stated that the laptops "jostle her leadership role" and that she felt that 
she was not always ahead of the students. None of the secondary school teachers at the 
experimental schools felt their roles were changed with the advent of the laptops. Three 
teachers emphasized that the need to teach to the test for subjects for which there are 
provincial exams imposes a major constraint on the integration of computer technology in 
their teaching. 

The majority of the teachers from both levels felt that they had a good predisposition 
toward the use of computer technology in teaching. The interview data showed that 
experimental teachers were using computer technology in fifteen and eleven different 
types of activities, respectively. On the other hand, control teachers were limited to three 
different types of activities namely searching the Internet for information, using email and 
doing projects. 

The single most often reported activity for which technology was used was to search the 
Internet for information (14 teachers). Control teachers made much less use of computer 
technology in their teaching. The second most frequently reported activity reported by 
experimental teachers was related to literacy and included writing (ten teachers) and 
grammar and spelling (two teachers). Finally, eight teachers reported using computer 
technology for projects and creating PowerPoint presentations for use in class. They also 
reported sharing files and information over the server (seven teachers), and using email 
and chat (six teachers). This was followed by creative activities such as creating digital 
videos (five teachers), mathematics (four teachers), and reviewing (three). Two 
elementary teachers stated that they use technology as an incentive for students to 
complete their work. 

Almost all experimental teachers reported that students were enthusiastic when they 
received the laptop computers. Initial negative responses from students were reported by 
three teachers and involved only one or two students in their classes who changed their 
minds after using the computers. The novelty, however, wore off with time. This was 
especially true for secondary 5 students who were reported to become frustrated with the 
technical problems associated with using their laptop computers. It was further 
compounded by the restrictions imposed by the schools for downloading games and music 
from the Internet. This loss of enthusiasm did not appear to be as noticeable with the cycle 
3 students, although two elementary teachers mentioned that with time, students brought 
their computers home less often than when they first received them. One teacher 
suggested that his/her students became more systematic about when and how they used 



their laptop computers. 


Teachers (13) from both levels reported that the integration of computer technology in 
learning increased student motivation. Several teachers observed an initial increase in the 
amount of writing students were producing. One elementary teacher commented that she 
now has to place a limit on the amount of written text produced, "If I asked them to write 
a story before, they would write a little bit and stop. Now, they write pages and pages." 
Another teacher added, "I think of one kid in particular who wouldn't want to write and now 
he writes ... He said he didn't like writing with a pencil." 

On the other hand, the secondary 5 teachers were more reserved in their assessment. One 
teacher suggested that there was an increase in motivation but not to the extent that she 
had expected. Others qualified their statements such as one teacher who stated "For a 
couple of students who have been very unmotivated to get things done, it's been great 
because they've got something accomplished. Maybe the first thing I've got in from them 
when it's writing." 

Student Interviews 

The students from the six experimental elementary schools were enthusiastic about having 
laptop computers in the classroom. To the question: Would you go back to not using your 
laptop computer in school if you had the choice? all students answered a resounding "no." 
One student answered, "No, we're born with that technology." Students from three 
elementary schools said that, given the choice, they choose to use the computer to do 
their work because it's faster. One student said that he enjoyed using his laptop for 
learning because it makes difficult work easier. 

All of the experimental students at the secondary 5 level said that they enjoyed using 
computer technology for learning. Students in one school stated that they would not want 
to go back to having to use computer rooms and labs to work. "It's good because you 
work on only one computer" said one student. Another stated, "I could live without it, but 
it's easier with." High school students' responses were not as enthusiastic as were 
responses from the elementary level students. The secondary 5 students tended to be 
more reserved in their assessment than the cycle 3 students. 

The most important reason for having computer technology for learning, as reported by the 
students of all experimental schools, was having rapid access to up-to-date information 
using the Internet and WorldBook for assignments, projects or presentations. The students 
believed that the information they found on the Internet was more reliable than what they 
found in books in the library because it was continuously updated. As one secondary 5 
student stated "The greatest benefit, I'd say, is probably being able to do research right 
here in class. We don't have to go to the library where things are outdated." 

The second most important benefit for using the laptops was for writing. Several students 
reported that it is easier to type than to write by hand and that "It improves on sloppy 
writing so teachers can read your work." One elementary level student stated, "I like my 



laptop because I used to hate writing stories, but now I'm better at it." 

Experimental secondary school students (six schools) believed that they learned more 
because of the laptop computers. In general, they associated this with the fact that the 
computers (and Internet access) are fast and that they can find more information on 
specific topics. Several students also described their learning experience similarly to one 
student who said "It's a different kind of experience because with the laptops you're 
learning how to type, you're learning math, you're learning how to research the internet, 
you're learning grammar, and you're learning different things like that. You're also learning 
how to put things together and check how technology works." When asked if the teacher 
asked more of them, one student responded, "Teachers ask more but it is so easy to get 
the information that you don't notice it." 

Discussion 

The university researchers and their school partners worked diligently to insure the highest 
methodological standards of research. This partnership meant there was special support 
and credibility offered to those who conducted the data collection and overall this 
enhanced the ecological validity of the research. Nevertheless, there were several 
problems that undermined this field-based inquiry. 

At the secondary level, the researchers compared the experimental board with a control 
board using statistical control and matching in order to approximate the equivalence 
produced by random assignment of participants. This was only partially successful. Had a 
larger sample of sites been available, this might have allowed for a closer matching of 
groups. In addition, the researchers attempted to use statistical control to remove the 
effects of extraneous influences and reduce the possibility that threats to internal validity 
operated as alternative explanations to a technology treatment effect. This too was only 
partially successful. The degree to which there were sufficient control variables, and 
especially those which correlated with the outcome measures, was limited. For example, 
geographic differences (e.g., urban versus rural), mother tongue language differences, 
context of data collection (e.g., seriousness of student completion of instruments, time 
available), prior achievement differences and a host of factors were not completely 
controlled for experimentally or statistically. 

At the elementary level, no control data were available. Nor did the timing of the research 
allow for the use of comprehensive pretesting prior to implementation of the laptop 
initiative. In future, more time and the use of the current data as baseline indices should 
make strong quasi-experimental designs possible (e.g., non-equivalent pretest-posttest 
control group design). Finally, the research process may have been weakened by 
differential selection of respondents that could be attributed to the nature of the consent 
forms and related procedures. 

It also bears noting that none of the between board and certainly none of the within board 
comparisons examine technology use versus non-use. It is not a case of whether 



computers are used but a case of degree of use and length of exposure. This may have 
resulted in diminished treatment effects. 

As a consequence of these problems, we have been careful to temper our conclusions. In 
addition, we attempted to triangulate the findings, wherever possible, to ensure that a 
conclusion seemed justifiable from several sources of evidence. 

Technology Use 

Almost all students, elementary and secondary, reported having a computer at home that 
they could use for schoolwork. Access to the Internet at home was less widespread but 
still reported by the majority of students (about 75%). More than 35% of students used a 
computer at home to complete schoolwork three or more hours per week. On this 
measure, there was no difference between elementary and secondary students; no 
difference between experimental and control students; and no difference between males 
and females. In contrast, approximately 45% of elementary students and 65% of 
secondary students who had received laptops reported using a computer for schoolwork at 
school three or more hours per week. This figure was only 20% for secondary students in 
the control board. This clearly shows that increased access to computers leads to a 
dramatic increase in the usage of computers for completing schoolwork. There is little 
evidence of a gender gap in the use of computers, at school or at home. Elementary IEP 
students have lower achievement scores but report that it is equally easy to use 
computers for performing a variety of tasks. IEP students are slightly (but not 
significantly) less likely to use a computer during classes but significantly more likely than 
other students to use a computer for homework outside classes 

The integration of computers is not equally apparent in all subject areas. The number of 
students who report using a computer is highest for English, lowest for mathematics, and 
moderate for social studies and science. As expected, experimental students are far more 
likely than control students to use a computer at school in all of their classes. For instance, 
the majority of experimental students (about 70%) at the secondary level use a computer 
in French and English class compared to only 5% for control students. The usage of 
computers in mathematics classes was dramatically lower in both experimental (18% for 
males and 4% for females) and control secondary schools (1% for both males and 
females). 

Attitudes and expectations 

The motivational dispositions of teachers should support expectations of success with 
technology (e.g., I can use technology with my students to help them learn), beliefs that 
the use of technology has value for learning (e.g., my students will learn more and at a 
higher level), and that the costs of technology use are manageable (e.g., the time to 
integrate technology into my classroom is reasonable). Similarly, students should increase 
their beliefs about technology as a tool for learning, value the tool, and see limited costs 
associated with its use as a pedagogical tool. Motivation to learn is a key building block of 
successful educational reform because it addresses the core concern of providing energy 



for action and directing it towards a meaningful goal. 


In this regard, the perceptions of teachers and students were quite interesting. In general, 
students held positive attitudes towards the use of technology for learning. Elementary 
students had more positive views about school in general and also about the use of 
technology to enhance learning. 

There was also some variability among teacher attitudes. As would be expected, teachers 
in the experimental board reported much higher access to computer technology and 
resources than did secondary teachers in the control board. In general, elementary 
teachers in the experimental board, and especially those in lead schools, held more 
positive attitudes than secondary teachers. Attitudinal differences found between the lead 
and year one elementary schools are interesting. Most of the significant TIQ findings show 
more positive results for the schools that received laptop computers earlier. It may be that 
over time, initial teacher concerns about the integration of technology will be reduced with 
experience. It could also be that lead schools were better prepared for the deployment 
than were schools that received the laptops at a later stage. Although elementary teachers 
were generally more positive, even they acknowledged that the use of computer 
technology in the classroom requires adequate teacher training, technical support, and 
extra time to plan learning activities. 

While high school teachers in the control board report higher levels of technology 
integration than at the experimental schools, control students overwhelmingly have 
indicated that this is not the case. This would be consistent with speculations voiced by 
administrators from the experimental board that students would be the driving force 
behind the success of the project. It is also consistent with the shift in paradigm between 
the traditional teacher-centred classrooms that preceded the reform of the Quebec 
Education Program to the student-centred environment that technology is supposed to 
facilitate. 

Secondary teachers in the experimental board expressed the most negative views about 
technology. The implementation of the laptop initiative may have increased apprehension 
from the teachers at the experimental schools to change. Principals at these high schools 
have indicated that their teachers simply are not eager to use laptops. Overall, high school 
teachers seem especially resistant to change when it is being imposed by outside forces, 
which is the case with the laptop initiative. School board officials now realize that if new 
initiatives come from within the school, teachers will be more likely to adopt the initiative. 
In support of this hypothesis, teachers from control schools using technology voluntarily 
report much higher ratings of integration and satisfaction. This suggests that strategies for 
change using technology may need to be varied depending on the level of teaching and the 
context in which computers are being deployed. 

Academic outcomes 

In terms of key academic indicators, potentially the most interesting finding is the 
difference in CAT-3 scores between the experimental and control boards. Secondary 



students at the experimental schools had higher scores on the CAT-3 reading test and 
indicated making six times more frequent use of computer technology in their English 
classes, suggesting a possible treatment effect. Others have found that the use of 
technology has a positive impact on student writing especially at the secondary level 
(Goldberg, Russell, & Cook, 2003; Jeroski, 2003; Lowther, Ross, & Morrison, 2003; 
Rockman, et al., 2000). In contrast, mathematics scores were higher at the control schools 
where neither board indicated high levels of computer use for math. Nevertheless, these 
findings must be interpreted with some caution until the threats to validity of selection bias 
are more clearly overcome. Otherwise, the measures of core academic competencies, 
student self-concept and student self-regulation serve as useful and important baseline 
measures against which future progress can be measured. 

Meaningful student-centred learning 

The first phase of technology integration is to insure that teachers and students are 
comfortable with the uses of the tool and its features. It is evident that this familiarity is 
well under way as the laptops are deployed and used regularly during the school day. 
Subsequent phases of the laptop initiative are intended to focus on deeper, more 
challenging pedagogical applications, which rely increasingly on student-centred learning, 
and cross-curricular competencies as described in the Quebec Education Program. 

Several decades ago, Benjamin Bloom argued for the importance of time-on-task as one 
key ingredient of learning success. It remains a key indicator of school success that 
teachers and students must be meaningfully engaged and, while technology can assist 
through its power and engagement, it is important that classroom management be in place 
so that the tool does not become a distraction. 

This may require new strategies for classroom management. Or it may merely indicate 
that teachers are better able to detect off-task behaviour in a computer environment. 
Regardless, an exploration of how and whether off-task behaviour using computers leads 
to meaningful incidental learning (i.e., what are the students doing when they are off 
task?) should be considered. 

School Success plans and goals are means by which these phases may be concretized. 
They can exist at multiple levels (e.g., board, school, teachers, and student) and they can 
be both short-term and long-term (e.g., more student collaboration, increased CAT-3 test 
results, etc.). 

In addition, both future training and support for technology should focus on advanced uses, 
once familiarity has been accomplished. Ideas include: a) ensuring that teachers and 
students are aware of and using curricular and cross-curricular tools for learning with 
technology (e.g., electronic portfolios to support self-regulation); b) science and math 
applications which provide guided support for complex learning, and multimedia tools for 
developing literacy skills, etc.; c) examining the pedagogical uses of digital learning 
aspects found in learning object repositories and learning design tools to assemble them; 
d) developing collaborative learning skills among students which focus on positive 



interdependence and individual accountability; e) facilitating teacher and student expertise 
in information literacy including access and retrieval strategies for the internet and the 
abilities to make judgments about the quality, veracity, and completeness of information; 
f) encouraging communities of practice among teachers and administrators by creating 
distributed learning networks both within and between schools linking educators together 
and opening the doors of their classrooms to one another; and g) focusing assessment and 
evaluation of the technology integration on both the products of the initiative (i.e., what 
has been accomplished) as well as the process of the initiative (i.e., how it has been 
accomplished), documenting the success stories and best practices so they can be 
replicated. 

Otherwise, the promise of technology must be tempered with the reality of the costs to 
purchase and maintain it even beyond the time and costs associated with learning how to 
use it wisely. In the former regard there is evidence in this initial report of the difficulties 
associated with maintenance. A technical problem is a reality that can compromise the 
dream, which future engineering developments may yet overcome. In the interim, 
technical support is a sine qua non of a computer-based learning environment. The 
hardware and software are still quirky and problematic especially for diverse and neophyte 
users. 

Finally, we have argued that it is of essential importance to conduct rigorous and 
longitudinal research on the impacts of ubiquitous technology use on teaching and learning 
—the products of technology integration. We need unambiguous answers to whether 
technology is effective, on which outcomes, with which students and teachers, at what 
school levels, and for which subject areas. But we also need to answer questions about 
what technology works and how—the process of technology integration. Future research 
should better document the nature of teaching and learning with technology, determine 
aspects of effective professional development and describe the cross-curricular, 
collaborative and student-centred learning activities which lead to the promotion of 
academic competencies, enhanced self-concept and better student self-regulation. 
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